Stochastic Optimal Control Problems with a Bounded Memory∗
نویسندگان
چکیده
This paper treats a finite time horizon optimal control problem in which the controlled state dynamics is governed by a general system of stochastic functional differential equations with a bounded memory. An infinite-dimensional HJB equation is derived using a Bellman-type dynamic programming principle. It is shown that the value function is the unique viscosity solution of the HJB equation. In addition, the computation issues are also studied. More particularly, a finite difference scheme is obtained to approximate the viscosity solution of the infinite dimensional HJB equation. The convergence of the scheme is proved using the Banach fixed point theorem. The computational algorithm is also provided based on the scheme obtained.
منابع مشابه
Time discretisation and rate of convergence for the optimal control of continuous-time stochastic systems with delay∗
We study a semi-discretisation scheme for stochastic optimal control problems whose dynamics are given by controlled stochastic delay (or functional) di erential equations with bounded memory. Performance is measured in terms of expected costs. By discretising time in two steps, we construct a sequence of approximating nitedimensional Markovian optimal control problems in discrete time. The cor...
متن کاملGeometric Programming with Stochastic Parameter
Geometric programming is efficient tool for solving a variety of nonlinear optimizationproblems. Geometric programming is generalized for solving engineering design. However,Now Geometric programming is powerful tool for optimization problems where decisionvariables have exponential form.The geometric programming method has been applied with known parameters. However,the observed values of the ...
متن کاملOptimal Control of Stochastic Functional Differential Equations with a Bounded Memory∗
This paper treats a finite time horizon optimal control problem in which the controlled state dynamics is governed by a general system of stochastic functional differential equations with a bounded memory. An infinite-dimensional HJB equation is derived using a Bellman-type dynamic programming principle. It is shown that the value function is the unique viscosity solution of the HJB equation.
متن کاملConvex integral functionals of regular processes
This article gives dual representations for convex integral functionals on the linear space of regular processes. This space turns out to be a Banach space containing many more familiar classes of stochastic processes and its dual is identified with the space of optional Radon measures with essentially bounded variation. Combined with classical Banach space techniques, our results allow for sys...
متن کاملSolution of Fractional Optimal Control Problems with Noise Function Using the Bernstein Functions
This paper presents a numerical solution of a class of fractional optimal control problems (FOCPs) in a bounded domain having a noise function by the spectral Ritz method. The Bernstein polynomials with the fractional operational matrix are applied to approximate the unknown functions. By substituting these estimated functions into the cost functional, an unconstrained nonlinear optimizat...
متن کامل